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The Basics of 

Numerical Filtering 



Creative number crunching can smooth out data in a control loop. 



To coffee drinkers and auto mechan- 
ics, "filtering* extracts unwanted 
contaminants from a stream of valu- 
able material. Control engineers, on 
the other hand, use numerical filters 
to extract streams of valuable data from mea- 
surement noise and other extraneous informa- 
tion (see the ^Filtering the feedback' graphic). 

The "Running average' sidebar shows how 
the most basic numerical filter— a running or mov- 
ing average— can extract the average value from 
a sequence of recent process variable measure- 
ments. Averaging is an especially effective meth- 
od for determining the true value of a process 
variable when the measuring device is prone to 
unpredictable fluctuations commonly described 
as noise. Measurement noise affects all industrial 
instruments to one degree or another. Variations 
in ambient conditions (especially temperature) 

Filtering the feedback 



Setpoint 



or interference from nearby electrical sources 
can cause an unfiltered instrument to report a 
skewed reading. Sometimes the measurement 
technology itself is not entirely accurate, caus- 
ing unfiltered measurements to deviate from the 
process variable's true value. 

If deviations are brief, random, and equally 
distributed between positive and negative val- 
ues, the noise will contribute no net effect to the 
average of recent measurements, so the readings 
reported by a filtered instrument will be accu- 
rate. Even if the noise is not strictly random and 
has a non-zero average or mean, an averaging fil- 
ter can compensate by detecting the mean and 
subtracting it from the instrument s readings. 

Alternative methods 

The ability to extract accurate measurements 
from noisy data makes numerical filtering cle 



Vance VanDoren, 
Ph.D., P.E. 

Control Engineering 



ONLINE 



For more from Vance Van 
Doren. search on "Vance" 

at www.controleng.con). 

Also read: Multivariable 
Controllers Balance 
Competing Obiectlves, 
from Sept.. 2 008 and 

Analyzing Closed Loop 
Behavior wilh Convolution, 
from July. 2008 at www. 
conlroleng.com/arsliive. 




A numerical titter insert- 
ed in the feedback path 
of a control hop can 
reduce the noise that 
often corrupts the pro- 
cess variable measure- 
ments. Less noise in the 
feedback path typically 
leads to smoother 
control efforts. 
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rigueur for virtually all industri- 
al instruments. However, most use 
more sophisticated and effective fil- 
tering techniques than a simple run- 
ning average. 

For example, a weighted average 
discounts older measurements in 
favor of newer ones when computing 
the instrument's reading, as in the 
* Weighted average' sidebar. Unlike 
a running average, this technique 
recognizes that the process variable 
changes over time so that recent mea- 
surements are likely a more accurate 
depiction of the current process vari- 
able than older measurements. 

The forgetting factor technique is 
similar, though more computation- 
ally efficient. It too gives greater 
weight to more recent measurements 
but requires fewer calculations and 
less memory than either a moving or 
weighted average. See the "Forgetting 
factor* sidebar. 



Mechanical filtering 




Source: Control Engineering 



At time kAt. water flows out of this tar* at a rate which is proportional to the 
volume of water it currently holds: 

F M W=AV(k) 
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The value of the constant A depends on 
the geometry of the tar*. A tail, 
narrow tank would have a larger value of 
A than a short, wide tank since a 
taller tank generates more pressure 
behind the outflow when filled with the 
sanm volume of water. Iftlie same 
relationship holds true a fraction of a 
second later at time (k+1 )4t, then 

F ollt (k + 1)=A-V(k + 1) 

The volume's rate of change over that 
interval is given by the difference 
between the inflow and outflow rates: 



V(k»1)-V(k) 
At 



:F jn (k)-F an (k) 



Combining these three relationships yields 
F ou ,(k + 1) = X-F out (kW1->0F m (k) 

X=1-AAt 



Wofe that this relationship t 
tank's inflow and outflow rates has the 
same form as a forgetting factor filter. 
That is. tlie tank averages the inflow rate 
to produce a smoother outflow rate, all 
by strictly mechanical means. 
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Running average 



The output of a running average filter at time (k» 1 )At is the average of 
the last n+1 inputs sampled at intervals of At seconds: 

f m ( ^ i) _ F M (k)*F B (h.1) --F B (k-n) 

For the purposes of a instrumenting a feedback control loop, the filter's 
inputs would be the rt+1 most recent process variable measurements, and 
the output would be the filtered reading reported by the instrument. Note that 
the output can also be computed recursively according to 



,(k,1) = F M (k), F " (l "- F »f"- 1) 
n + i 



This alternative approach involves fewer calculations but still requires 
storing all of the last n + 1 inputs somewhere in the filter's memory so that the 
value of F ln (k-n-1 ) can be recalled when needed. 



Filtering without a computer 

The forgetting factor technique also 
has the advantage of easy implemen- 
tation with simple mechanical or elec- 
trical devices, and does not require a 
computer. 

Consider, for example, the problem of 
extracting a smooth flow of water from 
an erratic source that is subject to ran- 
dom surges. A closed-loop flow control- 
ler could be installed with a valve and 
flow meter to counteract fluctuations 
in the upstream flow rate, but the same 
effect could be achieved by simply pass- 
ing the stream through a tank as shown 
in the 'Mechanical filtering' graphic. 

If the tank is large enough, the water 
level inside will eventually stabilize at a 



point where the outflow rate equals the 
average inflow rate. Fluctuations in the 
erratic inflow will be averaged out over 
time by the tank's storage capacity. The 
mathematical relationship between the 
two flow rates (as shown in the graphic) 
will have exactly the same form as a for- 
getting factor filter, though A is typically 
described as a time constant when such a 
filter is implemented by physical, rather 
than strictly numerical means. 

Challenges 

This example also demonstrates one of 
the principal drawbacks of using a filter 
to eliminate noise from a data stream (or 
in this case, a literal stream). Filtering 
slows down the measuring process. 



Weighted average 



■he output of a weighted average filter depends more heavily on the val- 
ues of the more recent inputs: 



F^fk+1) 



F »( k ) + « ' F »,( k -1)* + W - FJk-n) 



1 



The weighting factor w can be assigned a value between and 1 in order 
to quantify the relative importance of older vs. newer inputs. If w =0, the older 
inputs are discounted entirely. If w =1, ail inputs are given equal weight just 
like a running average. And like a running average, the output of a weighted 
average filter can be computed more efficiently with a recursive formula: 



F^(^i)^F M( k)+ F >»-: ,F >:"- i > 
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Imagine that the supply has been 
shut off somewhere upstream. Until the 
tank drains the outflow continues and 
does not indicate that the inflow rate has 
dropped to zero. A large tank would take 
longer to drain, prolonging the outflow 
and inflow disparity In other words, 
the tank would take a long time to 'for- 
get" the old inflow rate, so its forgetting 
factor/time constant would he particu- 
larly large. A large tank's storage capac- 
ity can average inflow rate fluctuations 
over a longer period of time, minimiz- 
ing the effect of any individual surge. 
Better averaging is also characteristic 
of a numerical filter with a large time 
constant. 

Process designers applying this 
mechanical filtering technique would 
size the tank to fit their objectives. A 
larger tank with a larger time constant 
would produce better averaging, but a 
smaller tank with a smaller time con- 
stant would be more responsive. 

The same design trade-offs affect 
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Forgetting factor 



A filter equipped with a forgetting factor X between and 1 gives more 
weight to more recent inputs much like a weighted average filter: 

F J><-1N1-X) • F„(k) ♦ x ■ (1 - a ) - F„ <k-1) ♦ K> (1-X) F„ (k-2) + - - • 

However, this technique incorporates all past inputs into the filler's output, 
not just the last n+ 1 . The input measurement that is mAt seconds old is dis- 
counted by a (actor of X m . so the filter essentially "forgets" older inputs at a 
rate given by X. If X=0, the older inputs are forgotten immediately. If X is close 
to f , the older inputs are forgotten relatively slowly. Note that the recursive 
version of the forgetting factor formula is the most computationally efficient of 
all averaging filters: 

F,Jk + 1)=X.F eu ,(k)* (1-X).F,„(k) 
current input and the current output need be stored at time k.\t for 





strictly numerical filters as well, espe- 
cially those in feedback control loops. 
A filter with a long time constant does 
a better job of eliminating measure- 
ment noise, but it averages actual chang- 
es in the process variable over time, so 
it takes longer for the controller to see 
the effects of its previous control efforts. 
If the controller is impatient, it could 
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apply more correction than necessary, 
much as when the process itself is slow- 
to respond because of excessive dead- 
time. jSee Dealing with Deadtime', 
Control Engineering. July 2005.) 

Sophisticated filtering 

These simple averages are only the most 
basic filtering techniques. Nth order fil- 
ters have N forgetting factors or time 
constants for improved performance. 
High pass filters preserve the high fre- 
quency components of the data stream 
rather than the low frequency compo- 
nents. Band pass filters discard both the 
highest and lowest frequency compo- 
nents and leave the mid-frequency com- 
ponents more or less in tact. Band stop 
filters perform the converse function. 

All these techniques have advantages 
and disadvantages, and all involve com- 
plex mathematical analysis. Fortunately, 
signal theory— the study of data, streams 
and methods for filtering them— is one 
of the most mature facets of control 
engineering since these techniques were 
developed in electrical engineering and 
telecommunications long before Ziegler 
and Nichols tuned their first loop. 

As a result, there is a host of design 
tools and software packages to assist 
developing a filter with desired charac- 
teristics These tools can also be used to 
design entire control loops since a feed- 
back controller is essentially a filter that 
acts on the measured error between the 
process variable and the setpoint to pro- 
duce a sequence of control efforts with 
desired characteristics eo 

Vance VanDoren is consulting editor 
to Control Engineering. Reach him at 
controleng@msn.com. 
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